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(54) Method and apparatus for processing a bitstream 



(57) Apparatus (100, 700) for processing a com- 
pressed input bitstream (112. 712) representing an 
information signal. The apparatus processes the com- 
pressed input bitstream in a way that changes the infor- 
mation signal represented by the compressed input 
bitstream. and comprises a layered decoder (114. 
71 4A) that decodes the compressed input bitstream to 
provide a decoded bitstream (116. 716A). a decoded 
bitstream processor (118, 71 8A) that processes the 
decoded bitstream to provide a modified bitstream (122. 
722A), a layered encoder (124. 724) that re-encodes 
the modified bitstream to provide a compressed output 
bitstream (126, 726), and a selective interconnection 
path (134. 215. 315. 138; 725. 721. 719. 738). The lay- 
ered decoder includes serially-connected decoding 
modules (e.g.. 201. 203. 705. 707). The decoded bit- 
stream processor processes the decoded bitstream in a 
way that modifies the information signal. The layered 
encoder includes serially-connected encoding modules 
(e.g., 301 . 303, 705, 707), each of which conesponds to 
one of the decoding modules in the layered decoder. 
The selective Interconnection path selectively connects 
the output of one of the decoding modules to the input 
of the decoded bitstream processor and selectively con- 
nects the output of the decoded bitstream processor to 
the input of the one of the encoding modules corre- 
sponding to the one of the decoding modules. The lay- 
ered decoder may include an element that derives 
bitstream parameters from the compressed input bit- 
stream, and the apparatus may additionally comprise a 
bitstream parameter fonwarding path that interconnects 
the layered decoder to the layered encoder. At least one 
of the encoding modules may be connected to the 



parameter fonA^arding path and may perform an encod- 
ing operation using the bitstream parameters derived 
from the compressed input bitstream. 
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Description 

Reld of the Invention 

The invention relates to processing bitstreams. and, 
in particular, to processing compressed bitstreams in a 
way that reduces the resources required to perfonm the 
processing. 

Background of the Invention 

Bitstreams representing information signals are 
often subject to compression to consen^e communica- 
tions bandwidth or signal storage requirements. For 
example, the bandwidth or signal storage required to 
transmit or store a video bitstream representing a 
motion picture can be reduced by a factor of the order of 
100 by applying suitable spatial and temporal compres- 
sion. Such spatial and temporal compression schemes 
include the MPEG-1 and MPEG-2 schemes standard- 
ized by the ISO. 

Production, distribution and display of video bit- 
streams representing video signals often involves 
processing the video bitstream in some way Such 
processing may nKxJrfy the video signal represented by 
the video bitstream. For example, the processing may 
apply color conrection or a different gamma correction, 
or may apply noise reduction to the video signal. Such 
processing may additionally or alternatively be per- 
formed to convert the video signal from one video 
standard to another. In this, the number of picture ele- 
merits (pixels) in each picture may be changed, and the 
picture rate may additionally or alternatively be 
changed. Moreover, when the video bitstream is com- 
pressed, the processing may also nrxxjify the bitstream 
characteristics of the compressed video bitstream. For 
example, the compressed video bitstream may be proc- 
essed to change its bit rate, or to restructure it so that it 
can be decoded using a decoder having a decoder 
buffer of a different size. 

An example of a conventional apparatus 10 for 
processing a compressed input bitstream is shown in 
Figure 1. In this example, the compressed input bit- 
stream is an MPEG-compliant video bitstream. Similar 
arrangements may be used for processing video k)it- 
streams compressed according to other standards. In 
the conventional apparatus 10 shown in Figure 1, the 
MPEG decoder 14 decodes the compressed input bit- 
stream 12 to recover the video bitstream 16. The video 
processor 18 applies the processing defined by the 
processing selection block 20 to the video bitstream 16 
to generate the modified video bitstream 22. TTie modi- 
fied video bitstream is fed to the MPEG encoder 24 that 
generates the compressed output bitstream 26 by reen- 
coding the modified video bitstream to have bitstream 
characteristics, such as bit rate, buffer size, etc.. defined 
by the processing selection block 20. The bitstream 
characteristics of the compressed output bitstream may 



be the same as, or different from, those of the com- 
pressed input bitstream 12. If the processing selected 
by the processing selection block only involves chang- 
ing the bitstream characteristics, the video processor 18 

5 simply passes the video bitstream 16 to the MPEG 
encoder 24 without modifying it. 

The encoding operation performed by the MPEG 
encoder 24 on the modified video bitstream 22 is con- 
siderably more computationally intensive than the 

10 decoding operation performed by the MPEG decoder 
14 on the compressed input bitstream 12. For example, 
to encode a video bitstream representing an NTSC 
video signal in real time requires special hardware or a 
computer based on a microprocessor of equivalent 

15 computing power to a 686-type microprocessor. Conse- 
quently, the conventional apparatus 10 is complex and 
expensive. 

Of the operations performed by the MPEG encoder 
24, the motion estimation operation used to determine 

20 the motion vector for each block is computationally the 
most intensive. The number of operations required to 
perform motion estimation can be scaled down by 
reducing the scope of the motion search region, or by 
using a fast motion search algorithm, but both of these 

25 approaches inevitably impair video quality. To ensure an 
acceptable video quality, the MPEG encoder 24 will 
encode most sequences using relatively large search 
regions with an efficient, but suboptimal, motion estima- 
tion algorithm notwithstanding the large computational 

30 resources that this approach demands. 

What is needed is the ability to perform the above- 
mentioned processing on conrpressed input bitstreams 
without the need for special hardware, or using a com- 
puter based on a lower-cost microprocessor. What is 

35 also needed is the ability to perform the above-men- 
tioned processing on compressed input bitstreams 
faster than in real time using currentiy-availak)le hard- 
ware. 

In video production and distribution environments. 

40 the video bitstream may be subject to a number of differ- 
ent processing operations. Multiple processing opera- 
tions are conventionally applied to the video bitstream 
by concatenating a number of processors. Each proces- 
sor operates on the conventional, pixel-le^^el. video bit- 

45 stream generated by the preceding processor. Such an 
arrangement of concatenated processors would replace 
the video processor 18 shown in Figure 1 . 

Using a concatenated anangement of processors 
to perform multiple processing operations on a video 

50 bitsti'eam normally requires that tfie video bitstream 
operated on by each processor be a conventional video 
bitstream. Processors that operate on compressed or 
partially-compressed video bitstreams cannot be con- 
catenated witti processors tiiat operate on conventional 

55 video bitstreams or with processors that operate on 
video bitsti-eams tiiat are differently compressed. More- 
over, processors tiiat are designed to operate on a con- 
venttonal video bitstream, i.e.. on an uncompressed 
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video bitstream. require that computational resources 
be expended to decode the corrpressed Input bitstream 
fuliy before processing, and to fully re-encode the mod- 
ified bitstream generated by the processors. Finally, 
processing systems that precede the processors by a 
conventional decoder and follow the processors with a 
conventional encoder require the compressed input bit- 
stream to be compressed according to the compression 
standard of the decoder, and provide the output bit- 
stream compressed according to the compression 
standard of the encoder. 

Accordingly^ what is also needed is a video 
processing system that allows processors that operate 
on bitstreams in different states of compression to be 
concatenated, that can process a compressed input bit- 
stream in any state of compression and that can gener- 
ate a compressed output bitstream in a state of 
compression that is greater than, less than, or the same 
as that of the compressed input bitstream. 

Summary of the Invention 

The invention provides an apparatus for processing 
a compressed input bitstream representing an informa- 
tion signal such as a video signal. The apparatus proc- 
esses the compressed input bitstream in a way that 
changes the information signal represented by the com- 
pressed input bitstream. The apparatus comprises a 
layered decoder that decodes the conpressed input bit- 
stream to provide a decoded bitstream, a decoded bit- 
stream processor that processes the decoded bitstream 
to provide a modified bitstream, a layered encoder that 
re-encodes the modified bitstream to provide a com- 
pressed output bitstream. and a selective interconnec- 
tion path. The layered decoder includes serially- 
connected decoding nxxiules. The decoded bitstream 
processor processes the decoded bitstream in a way 
that modifies the infbnmation signal. The layered 
encoder includes serially-connected encoding modules, 
each of which con-esponds to one of the decoding mod- 
ules in the layered decoder. The selective interconnec- 
tion path selectively connects the output of one of the 
decoding modules to the input of the decoded bitstream 
processor and selectively connects the output of the 
decoded bitstream processor to the input of the one of 
the encoding nxxiules corresponding to the one of the 
decoding modules. 

The invention also provides an apparatus for modi- 
fying the bitstream characteristics of a compressed 
input bitstream representing an information signal. This 
apparatus modifies the bitsb'eam characteristics of the 
compressed input bitstream without necessarily sub- 
stantially changing the information signal represented 
by tiie compressed input bitstream. The apparatus com- 
prises a controller that provides an output bitstream def- 
inition defining the bitsti'eam characteristics of a 
compressed output bitstream; a layered decoder that 
includes a deriving element that derives bitstream 



parameters from ttie compressed input bitstream; a bit- 
stream parameter forwarding path; and a layered 
encoder that generates the compressed output bit- 
stream. The layered decoder decodes the compressed 

5 input bitstream to provide a decoded bitsti^eam. The bit- 
stream parameter fbnwaiding path is connected to 
receive the bitstream parameters from the layered 
decoder. The layered encoder is connected to the bit- 
stream parameter forwarding path and re-uses the bit- 

10 stream parameters derived from the compressed input 
bitstream to re-encode the decoded bitstream in 
accordance with the output bitsb'eam definition. 

The invention also provides a method for process- 
ing a compressed input bitstream representing an infor- 
ms mation signal. The method processes the compressed 
input bitstream in a way that changes the information 
signal represented by the compressed input bitstream. 
In the method, the compressed input bitstream is par- 
tially decoded to provide a decoded bitstream. The 

20 decoded bitstream Is a partially-encoded bitstream rep- 
resenting the information signal. A nrxxlified bitstream is 
generated by processing the decoded bitstream in a 
way that modifies the information signal. The modified 
bitstream is a partially-encoded bitstream. Finally, the 

25 nfKXjified bitstream is re-encoded to generate a com- 
pressed output bitstream. 

The invention further provides a method for modify- 
ing the bitstream characteristics of a compressed input 
bitstream representing an information signal. This 

30 method modifies the bitstream characteristics without 
necessarily substantially changing tiie information sig- 
nal represented by the compressed input bitstream. In 
tiie method, an output bitstream definition is generated. 
The output bitstream definition defines tiie bitstream 

35 characteristics of a compressed output bitstream. Bit- 
stream parameters are derived from the compressed 
Input bitstream. The compressed input bitstream is at 
least partially decoded to provide a decoded bitstream. 
Finally, the decoded bitstream is re-encoded using the 

40 parameters derived from tiie compressed input bit- 
stream to generate tiie compressed output bitstream 
having the bitsti'eam characteristics defined by tiie out- 
put bitstream definition. 

The invention also provides an apparatus for 

45 processing a compressed input bitstream representing 
an information signal. The apparatus processes tiie 
compressed input bitsti^eam in a way tiiat changes ttie 
information signal represented by tiie compressed input 
bitstream. The apparatus comprises a first compression 

so state translation unit, a processor and a second com- 
pression state translation unit. The first compression 
state translation unit receives the compressed input bit- 
stream as an input bitstream and changes the compres- 
sion state of the compressed input bitstream to 

55 generate an output bitstream. The processor receives 
tiie output bitstream of the first compression state trans- 
lation unit, and processes the output bitstream to gener- 
ate a modified bitstream. The processor processes tiie 
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output bitstream In a way that modifies the information 
signal. The second compression state translation unit 
receives the modified bitstream as an input bitstream 
and changes the compression state of the nxxlif ied bit- 
stream to generate an output bitstream as the conv- 
pressed output bitstream. 

The first and second compression state translation 
units each include layered encoding/decoding modules, 
an input interface module and an output interface mod- 
ule. The input interface module selectively connects the 
input bitstream to one of the encoding/decoding mod- 
ules. The one of the encoding/decoding modules to 
which the input bitstream is connected depends on the 
compression state of the input bitstream. TTie output 
interface nxxiule selectively receives a bitstream from 
the output of one of the encoding/decoding modules as 
the output bitstream. The one of the encoding/decoding 
modules from which the bitstream is received depends 
on the compression state of the output bitstream. The 
compression state of the output bitstream may be differ- 
ent from that of the input bitstream. 

Finally, the invention provides a method for 
processing a compressed input beam representing an 
information signal. In the method, layered encod- 
ing/decoding modules are provided. A first set of encod- 
ing/decoding modules and a second set of 
encoding/decoding modules are selected from the lay- 
ered encoding modules. The compression state of the 
compressed Input bitstream Is changed to provide a first 
output bitstream using the first set of encoding/decoding 
modules. TTie first output bitstream is processed to gen- 
erate a modified bitstream. The first output bitstream is 
processed by in a way that modifies the information sig- 
nal but generates the modified bitstream in the same 
compression state as the first output bitstream. Finally, 
the connpresston state of the modified bitstream is 
changed using the second set of encoding/decoding 
modules to generate a second output bitstream. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a conventional appa- 
ratus for processing a compressed Input bitstream. 
Figure 2 is a block diagram of a first embodiment of 
an apparatus according to the invention for 
processing a compressed input bitstream. 
Figure 3 is a block diagram showing part of the first 
embodiment of the apparatus according to the 
invention in more detail. 

Figure 4 is a block diagram that illustrates how bit- 
stream parameters derived from the compressed 
input bitstream are re-used in the layered encoder 
in the apparatus according to the Invention. 
Figure 5 Is a flow chart that illustrates a first way in 
which quantizing is performed in the layered 
encoder by re-using quantizing parameters derived 
from the compressed input bitstream. 
Figure 6 is a f tow chart that illustrates a second way 



in which quantizing is performed in the layered 
encoder by re-using quantizing parameters derived 
from the compressed input bitstream. 
Rgure 7A Is a block diagram of a second embodl- 

5 ment of an apparatus according to the invention for 
processing a conpressed Input bitstream. 
Rgure 7B is a block diagram showing details of the 
compression state translation units of the second 
embodiment of the apparatus according to the 

10 invention. 

Detailed Description of tlie invention 

In the following description, reference will be made 

15 to the compression state of an information signal. Bit- 
streams compressed according to MPEG and similar 
compression schemes are the result of a prescribed 
number of layers of compression applied to the original 
information signal. Conrtpressed bitstreams can also be 

20 generated by applying fewer than the prescribed 
number of layers of compression to the infbmiation sig- 
nal. Accordingly, a compressed bitstream representing 
an information signal can be regarded as having a com- 
pression state that depends on the number of layers of 

25 compression that have been applied to the information 
signal. The compression state of a compressed bit- 
stream can be increased by applying additional layers of 
encoding operations to the compressed bitstream, and 
can be decreased by applying layers of decoding oper- 

30 ations to the compressed bitstream. 

A first embodiment 100 of a compressed bitstream 
processing apparatus according to the invention is 
shown in Figure 2. The example shown is adapted for 
processing an MPEG-compliant video bitstream. but 

35 can easily be adapted for processing other types of 
compressed bitstreams representing Information sig- 
nals. The compressed bitstream processing apparatus 
100 is composed of four main units, the layered decoder 
114, the decoded bitstream processor 118. the layered 

40 encoder 124 and the bitstream parameter forwarding 
path 128 that interconnects the layered decoder and the 
layered encoder. In addition, if the compressed bit- 
stream processing apparatus is designed to allow a 
user to select or define the processing operation per- 

45 formed, the apparatus additionally includes the 
processing selection module 120 that receives Instruc- 
tions from the user and controls the processing per- 
formed by the layered decoder, the processor and the 
layered encoder. Otherwise, the processing selection 

50 module controls the processing performed by the lay- 
ered decoder, the bitstream processor and the layered 
encoder so that the compressed bitstream processing 
apparatus performs a predetermined processing opera- 
tion on the conpressed input bitstream. 

55 The layered decoder 1 1 4 decodes the compressed 
Input bitstream 112 to generate the decoded bitstream 
1 16 and passes the decoded bitstream to the decoded 
bitstream processor 118. The layered decoder gener- 
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ates the decoded bHstream in the compression state 
required by the decoded bitstream processor 118. For 
example, when the decoded bitstream processor is a 
conventional bitstream processor that operates on a 
conventional video bitstream, the decoded bitstream is 5 
a conventional video bitstream. Alternatively, the 
decoded bitstream processor may operate on a par- 
tially-compressed video bitstream, such as a bitstream 
composed primarily of DCT coefficients. In this case, 
the decoded bitstream is composed primarily of DCT 10 
coefficients. 

The layered decoder 1 14 additionally derives from 
the compressed input bitstream various parameters that 
will be called bitstream parameters. The bitstream 
parameters are parameters that are extracted from the is 
compressed input bitstream 112. or that are derived by 
the layered decoder in the course of decoding the com- 
pressed input bitstream. In the following description, the 
term derived will be understood to encompass either of 
these possibilities. The bitstream parameters coilec- 20 
tively define each picture of the video bitstream repre- 
sented by tiie compressed input bitstream, and include 
coded, quantized DCT coefficients, motion vectors, 
quantizing tables, macrotslock-type information, and 
header information. The header information includes 25 
statistical information such as the number of bits per 
block and ttie number of bits per picture. The layered 
decoder fbnvards the bitstream parameters to the lay- 
ered encoder 124 through the bitstream parameter for- 
warding path 128. 30 

The decoded bitstream processor 118 processes 
the decoded bitsfream 1 16 it receives from the layered 
decoder 114, and passes the resulting modified bit- 
stream 122 to the layered encoder 124. The layered 
encoder is also connected to the bitstream parameter 35 
fonvarding path 128 from which it receives the bitstream 
parameters derived from the compressed input bit- 
stream 112 by the layered decoder. The layered 
encoder generates the compressed output bitstream 
126 by wholly or partially re-encoding the modified bit- 40 
stream. In this embodiment, the extent of the re-encod- 
ing performed by the layered encoder is the same as the 
extent of tiie decoding performed by the layered 
decoder. 

The layered decoder 114 operates only to decode 4S 
the compressed input bitstream 1 1 2 to the state of com- 
pression required by the decoded bitstream processor 
118. This state of compression is less tiian ttiat of the 
compressed input bitsti-eam 112, but may be greater 
than that of a conventional video bitsfream. In this so 
embodiment, the modified bitstream 122 is in the same 
state of compression as the decoded bitstream 116. 
The layered encoder 124 re-encodes tfie modified bit- 
stream re-using at least some of the bitsti-eam parame- 
ters derived from the compressed input bitstream 112 ss 
by the layered decoder 114. Re-using the bitstream 
parameters saves tiie layered encoder from expending 
computational resources to calculate new parameters 



equivalent to the bitstream parameters that are re-used. 
Consequentiy, tiie compressed bitstream processing 
apparatus 100 according to the invention can perform 
the desired processing of the compressed input bit- 
stream using a smaller scale of hardware or a less pow- 
erful computer or digital signal processor than a 
conventional compressed bitstream processing appara- 
tus. Alternatively, compared witti a conventional appara- 
tus, ttie compressed bitstream processing apparatus 
according to the invention can perform tiie desired 
processing at a faster rate. e.g.. faster than real-time, 
using given hardware or a given conputer. 

The compressed bitsti-eam processing apparatus 
100 will now be described in more detail. In particular, 
the layered decoder 114 and the layered encoder 124 
will be described in detail with reference to Figures 2 
and 3. 

The layered decoder 1 1 4 will be described first. The 
layered decoder receives the compressed input bit- 
stream 112, partially or fully decodes ttie compressed 
input bitsti-eam. and supplies the resulting decoded bit- 
stream 116 to the decoded bitsti-eam processor 118. 
The layered decoder also derives bitstream parameters 
from the compressed input bitstream and supplies the 
bitstream parameters to the layered encoder 124 via the 
bitstream parameter forwarding path 128. In the exam- 
ple shown, the compressed input bitstream and tiie 
compressed output bitstream 1 26 are both MPEG-com- 
pliant video bitstreams. 

Like a conventional MPEG decoder, ttie layered 
decoder 114 includes a number of serially-connected 
decoding modules that operate together to decode the 
compressed input bitstream 112. Unlike a conventional 
MPEG decoder, ttie layered decoder can stop decoding 
ttie compressed input bitstream at the completion of 
decoding by any one of the decoding modules so that 
the compressed input bitstream is decoded only to ttie 
compression state required by tiie decoded bitstream 
processor 118. The decoding module at which the lay- 
ered decoder stops decoding depends on decoding 
control data supplied by the processing selection mod- 
ule 120 via tfie confrol path 132. When the decoding 
control data set the layered decoder so ttiat all the 
decoding modules operate to decode the compressed 
input bitstream. the layered decoder decodes ttie com- 
pressed input bitsti-eam to generate ttie decoded bit- 
stream 116 as a conventional video bitstream. The 
pictiares of a conventional video bitstream are in presen- 
tation order and the bitstream includes a pixel value for 
each pixel of each picture. When the decoding conti^ol 
data set ttie layered decoder so ttiat fewer ttian all ttie 
decoding modules are selected to decode ttie com- 
pressed Input brtstteam. the compressed Input bit- 
stream is only partially decoded. In this case, the 
decoded bitstream 116 is not a conventional video bit- 
stream, but is partially compressed. For example, ttie 
decoded bitstream may comprise a set of DCT values 
for each block of each picture. 
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Since the layered decoder 114 can stop decoding 
the compressed input bitstream at the completion of 
decoding by any one of the decoding modules, the out- 
put of each decoding module is not only connected to 
the input of the following decoding module, but is also 5 
connected to the output bus 134 that feeds the output 
selector 215. The output selector will be described in 
more detail below. 

The decoding nxxjules that constitute the layered 
decoder 1 14 are based on con-esponding modules of a 10 
conventional MPEG decoder. It is assumed that the per- 
son of ordinary skill in this art is familiar with the struc- 
ture and operation of such conventional modules, so the 
decoding modules will only be described briefly. The 
decoding modules include the decoder buffer 201, the is 
demultiplexer 203. the inverse variable-length coder 
205, the inverse quantizer 207, the inverse discrete 
cosine transform module 209, the motion compensator 
211 and the spatial bitstream output module 213. 

The compressed input bitstream. a constant bit-rate 20 
video stream in this example, is temporarily stored in 
the decoder buffer 201. The compressed input bit- 
stream is transferred from the decoder Ixjffer to the 
demultiplexer 203 one picture at a time in response to 
timing control data located in headers embedded in the 25 
bitstream. The demultiplexer divides the portion of the 
compressed input bitstream relating to each picture into 
Its constituent bitstream parameters. The bitstream 
parameters collectively define each picture of the video 
bitstream represented by the compressed input bit- 30 
stream, and include coded, quantized DCT coefficients, 
motion vectors, quantizing tables, macroblock-type 
information, color data, and header information. The 
header information includes statistical information such 
as the number of bits per block and the nunrtber of bits 3S 
per picture. The decoder bitstream parameter bus 136 
Interconnects the output of the demultiplexer with inputs 
of the other decoding modules, and passes the bit- 
stream parameters from the demultiplexer to the other 
decoding modules. The decoding modules each per- 40 
form a decoding operation using not only the data 
received from one or more preceding decoding modules 
but also the bitstream parameters received via the 
decoder bitstream parameter bus. In addition, the 
decoder bitstream parameter bus is connected to the 4S 
bitstream parameter forwarding module 130 to form part 
of the bitstream parameter fonwarding path 128. 

The bitstream parameter fonwarding module 130 
receives the bitstream parameters from the layered 
decoder 114 via the decoder bitstream parameter bus so 
136. The bitstream parameter fooAarding nxxlule tem- 
porarily stores those of the bitstream parameters that 
will be used by either or both of the decoded bitstream 
processor 118 and the layered encoder 124 until they 
are needed. The bitstream parameter forwarding mod- 55 
ule also feeds the bitstream parameters to an appropri- 
ate channel of the encoder bitstream parameter bus 
140. The encoder bitstream parameter bus connects 



the bitstream parameters to the encoding modules of 
the layered encoder in which the bitstream parameters 
will later be used to re-encode the modified bitstream 
122. 

The inverse variable length coder 205 receives the 
coded, quantized DCT coefficients from the demulti- 
plexer 203 and reverses the variable length coding 
applied to these coefficients to generate quantized DCT 
coefficients. The quantized DCT coefficients are fed to 
the inverse quantizer 207 and also to the output bus 1 34 
for connection to the output selector 215. In addition, 
the quantized DCT coefficients may be fed as bitstream 
parameters to the bitstream parameter fbnAfarding path 
128 for fbnwarding to the layered encoder 124. 

The inverse quantizer 207 receives the quantized 
DCT coefficients from the inverse variable length coder 
205, and also receives the quantizing tables from the 
demultiplexer 203 via the decoder bitstream parameter 
bus 136. TTie inverse quantizer reverses the quantizing 
applied to the quantized DCT coefficients to generate 
blocks of DCT coefficients. The DCT coefficients are fed 
to the inverse DCT module 209, and also to the output 
bus 134 for connection to the output selector 215. In 
addition, the DCT coefficients may be fed as bitstream 
parameters to the bitstream parameter forwarding path 
128 for fonvarding to the layered encoder 124. 

The inverse DCT module 209 receives the blocks of 
DCT coefficients from the inverse quantizer 207 and 
applies an Inverse discrete cosine transfbnm to the 
blocks of DCT coefficients to generate respective blocks 
of differences. The blocks of differences are fed to the 
motion compensator 211, and also to the output bus 
134 for connection to the output selector 215. In addi- 
tion, the blocks of differences may be fed as bitstream 
parameters to the bitstream parameter forwarding path 
128 for forwarding to the layered encoder 124. 

The motion compensator 21 1 receives the blocks of 
differences from the inverse DCT nrKXiule 209 and also 
receives respective reference blocks from a recon- 
structed picture stored in a page of a picture memory 
(not shown) in the spatial bitstream output module 213. 
The picture memory selects the respective reference 
blocks from the reconstructed picture in response to the 
motion vectors for the blocks of differences. The picture 
memory receives the motion vectors from the multi- 
plexer 203 via the decoder bitstream parameter bus 
136. The motion compensator adds each difference in 
the block of differences to a corresponding pixel value in 
the reference block to generate a new pixel value of a 
new reconstructed picture block. The motion compen- 
sator feeds the reconstructed picture block to the spatial 
bitstream output module 213. The motion compensator 
also feeds the reconstructed picture block onto the out- 
put bus 134 for connection to the output selector 215. 
The successive reconstructed picture blocks fed to the 
output selector constitute a block-format video bitstream 
in which the pictures are in coding order. Coding order 
differs from presentation order. I.e.. the order in whk:h 
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the pictures are presented to the viewer. 

When the block of differences is a block of a picture 
that has been encoded as a B-picture, the reference 
block may be selected from two reconstructed pictures 
stored in the picture memory. However, to sirnplify the s 
following description, a reference to selectirig a block of 
a reconstructed picture will be taken to encompass 
selecting blocks of more than reconstructed picture 
when the picture is decoded or encoded as a B-picture. 

The spatial bitstream output module 213 receives io 
each reconstructed picture block from the motion com- 
pensator 21 1 and stores the reconstructed picture block 
in the picture memory as a block of a reconstructed pic- 
ture being constructed in a page of the picture memory. 
This page is different from the page in which the picture is 
that supplied the reference block is stored. When all the 
blocks of a reconstructed picture have been stored in 
the picture memory, the reconstructed picture is availa- 
ble for the spatial bitstream output module to read it out 
onto the output bus 1 34 for connection the output selec- 20 
tor 215. The spatial bitstream output module reads out 
the reconstructed picture in raster scan fbrmat and in 
presentation order as a picture of a conventional video 
bitstream. 

As noted above, the inverse variable-length coder 25 
205, the inverse quantizer 207, the inverse DCT module 
209. the motion compensator 21 1 and the spatial bit- 
stream output module 213 operate selectively in 
response to the decoding control data received from the 
processing selection module 120 via the oontrol path 30 
132. The decoding control data select the decoding 
modules actually used to decode the compressed input 
bitstream. For example, if the user commands the sys- 
tem to perform spatial filtering on the compressed input 
bitstream. and the decoded bitstream processor 1 18 is 35 
capable of performing such filtering on blocks of DCT 
coefficients, the decoding control data will enable the 
inverse variable-length coder 205 and the inverse quan- 
tizer 207. and will cause the output selector 215 to con- 
nect the partially-decoded bitstream from the inverse 40 
quantizer to the decoded bitstream processor 118 as 
the decoded bitstream 1 16. The decoding control data 
will also deactivate the decoding modules downstream 
of the decoding module whose output is selected as the 
decoded bitstream 116, i.e., the inverse DCT module 4S 
209, the motion compensator 21 1 and the spatial bit- 
sti^eam output module 213. These decoding modules 
can be deactivated since they are not required to 
decode the conpressed input bitstream to the DCT 
coefficient level. This enables computational resources so 
that would othenA^ise be used for these decoding nrxxl- 
ules to be used for otiier purposes. 

In the layered decoder 1 14. the output selector 215 
is connected to the output bus 134. through which it 
receives tiie outputs of the decoding modules 201 -21 3. ss 
The output selector is also connected to the control path 
132 ttirough which it receives the decoding oontrol data. 
The output of the output selector is connected to the 



input of the decoded bitsti-eam processor 118. In 
response to the decoding control data, the output selec- 
tor selects the output of one of tiie decoding modules 
that will serve as the decoded bitstream 1 16, and feeds 
this bitstream to the input of the decoded bitstream 
processor 118. 

It should be noted that when the compressed bit- 
stream processing apparatus 100 according to the 
invention is emtxxJied in a computer or digital signal 
processor, the computer or digital signal processor may 
lack elements such as the bitstream parameter forward- 
ing path 128. tiie bitstream parameter forwarding mod- 
ule 130, the output bus 134 and tiie decoder bitstream 
parameter bus 136. Instead, for example, the output 
selector 215 may communicate to the decoded bit- 
stream processor 118 the addresses where the data 
output by the last of tiie decoding modules to decode 
the compressed input bitstream are stored. The 
decoded bitstream processor can tiien fetch tiie data 
stored at these addresses and perform the decoded bit- 
stream processing on these data. Similarly, the bit- 
stream parameter fonvarding path 128 may 
communicate to the layered encoder 124 tiie addresses 
at which the bitstream parameters derived from the 
compressed input bitstream by tiie layered decoder are 
stored. The appropriate encoding module of the layered 
encoder 124 can ttien fetch the bitsfream parameters 
stored at these addresses to use them in performing its 
encoding processing. It should also be noted that, in 
computer-based and DSP-based embodiments, the 
decoding modules may be ephemeral, and the appara- 
tus may lack elements corresponding to tiiose of tiie 
decoding modules tiiat are not used to decode the com- 
pressed input bitsfream 112. 

TTie decoded bitstream processor 118 will be 
described next. The decoded bitstream processor 
receives the decoded bitstream 116 from the layered 
decoder 1 14 and processes the decoded bitstream to 
generate the nxxjified bitstream 122. The decoded bit- 
stream processor can perform any conventional 
processing operation ttiat is not part of the MPEG com- 
pression. These processing operations include color 
correction, scaling, sharpening, noise reduction, etc. In 
the example shown, the processing operation per- 
formed by the decoded bitstream processor 1 18 on ttie 
decoded bitstream 1 1 6 is user specific, and is set by ttie 
user's input to the processing selection module 120. 

The processing operation performed by tiie 
decoded bitstream processor 1 18 depends on the com- 
pression state of the decoded bitstream 116. For exam- 
ple, the decoded bitst^eam processor can perform a 
picture sharpening operation on either tiie conventional 
video bitstream generated by the spatial bitsf eam out- 
put module 213 or the DCT coefficients generated by 
the inverse quantizer 207. To achieve the desired pic- 
ture sharpening result, the decoded bitstream proces- 
sor will perform a different picture sharpening operation, 
depending on whether tiie decoded bitstream 116 was 
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generated by the spatial bitstream output module or by 
the inverse quantizer. 

Whether the decoded bitstream 116 processed by 
the decoded bitstream processor 1 1 8 is the result of the 
layered decoder 114 fully decoding or only partially 
decoding the compressed input bitstream 112 depends 
on a trade-off between picture quality and computa- 
tional complexity. For example, when the decoded bit- 
stream processor performs a picture sharpening 
operation on the conventional video bitstream gener- 
ated by the spatial bitstream output module 213 of the 
layered decoder, the results are typically subjectively 
better than when those obtained when the decoded bit- 
stream processor perfbrms a picture sharpening opera- 
tion on the DCT coefficients generated by inverse 
quantizer 207. However, the decoded bitstream proces- 
sor operating on the conventional video bitstream is less 
cost effective because more computational resources 
must be expended to provide the additional decoding 
and encoding modules required for the layered decoder 
to decode the compressed irput bitstream to the con- 
ventional video bitstream level and for the layered 
encoder to re-enoode the modified video bitstream from 
the conventional video bitstream level. 

In instances in which the compressed bitstream 
processing apparatus 100 is configured to modify the 
bitstream characteristics of the compressed input bit- 
stream 112 without modifying the video signal repre- 
sented by the compressed input bitstream. the 
processing selector 120 configures the decoded bit- 
stream processor 1 18 as an identity unit, and the modi- 
fied bitstream 122 is identical to the decoded bitstream 
116. Examples of modifying the bitstream characteris- 
tics of the compressed input bitstream include changing 
the bit rate, changing the reference buffer size, chang- 
ing the quantizing table, etc. 

The layered encoder 124 will be described next, 
also with reference to Rgures 2 and 3. A key feature of 
the layered encoder lies in that it re-encodes the modi- 
fied bitstream 122 using the bitstream parameters 
derived from the compressed input bitstream by the lay- 
ered decoder 114. Using the bitstream parameters in 
the layered encoder enables the layered encoder to re- 
encode the nxxlified bitstream using fewer computa- 
tional resources than if it generated the bitstream 
parameters anew. For example, re-encoding the nxxJi- 
fied bitstream using the motion vectors and DCT infor- 
mation derived from the compressed Input bitstream 
can significantly reduce the computational resources 
required to perform many modifications to the bitstream 
characteristics of the compressed input bitstream. For 
example, such modifications of the bitstream character- 
istics as bit-rate conversion, decoder buffer size 
change, and picture size scaling can be performed. 
When such modifications of the bitstream characteris- 
tics are performed, the re-encoding can be performed 
using either the original motion vectors derived from the 
connpressed Input bitstream, or new motion vectors. 



The new motion vectors are generated using the origi- 
nal motion vectors as the starting points for a signifi- 
cantly simpler local search. The decision on whether to 
expand the additional computing resources required to 

5 generate new motion vectors involves a trade-off 
between the quality of the motion vectors and the addi- 
tional computing resources required. When the original 
motion vectors are used to re-encode the modified bit- 
stream after picture scaling, they must also be scaled In 

10 proportion to the picture scaling factor. 

The layered encoder 124 can also re-encode the 
modified bitstream 122 using information relating to the 
DCT coefficients of the compressed input bitstream 1 12 
as bitstream parameters. This provides both computa- 

15 tional expediency and reduces the computational 
resources required to control the encoder buffer and 
output bit rate. For example, the DCT module of the lay- 
ered encoder can use bitstream parameters that indi- 
cate the locations of the non-zero DCT coefficients in 

20 each block in the compressed input bitstream to 
improve the speed at which it computes the fbnvard 
DCT. The DCT module need only compute the DCT 
coefficients for the non-zero k)cations indicated by the 
bitstream parameters. Furthermore, the quantizer of the 

25 layered encoder can use bitstream parameters that indi- 
cate the bit statistics of the DCT coefficients of the com- 
pressed input bitstream to control the quantizing factor 
"MQUANT" 

The layered encoder 124 generates the com- 
30 pressed output bitstream 126 from the modified bit- 
stream 122 output by the decoded bitstream processor 
118. In the example shown in Figures 2 and 3, the com- 
pressed output bitstream is an MPEG-compliant video 
bitstream with a new set of user-specific MPEG header 
35 constraints defined by the processing selection module 
120. However, the header information of the com- 
pressed output bitstream may or may not be the same 
as that of the compressed input bitstream 1 1 2 in all lay- 
ers except the data layer. The layers include sequence, 
40 GOP. picture, slice, MB. and any extension header infor- 
mation. 

It is important to understand the principal difference 
between layered encoder 124 and the decoded bit- 
stream processor 118. Unlike the decoded bitstream 

45 processor, the layered encoder is only responsible for 
generating the conrpressed output bitstream 126 based 
on the user-specified header information and the modi- 
fied bitstream 122 from the decoded bitstream proces- 
sor 118. The layered encoder does not alter the video 

50 signal represented by the compressed output bitstream, 
except that the quantizer of the layered encoder may 
quantize the DCT coefficients differently from the way in 
which they were quantized in the compressed input bit- 
stream. 

55 The layered encoder 124 receives the modified bit- 
stream 122 from the decoded bitstream processor 1 18, 
re-encodes the modified bitstream using bitstream 
parameters derived from the compressed input bit- 
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stream 112 by the layered decoder 114, and supplies 
the resulting compressed output bitstream 126 as the 
output of the compressed bitstream processing appara- 
tus 100. The bitstream parameters are forwarded from 
the layered decoder to the layered encoder via the bit- 
stream parameter fbnwarding path 128. The layered 
encoder re-encodes the nfKxJified bitstream only to the 
extent required by the compression state of the modified 
bitstream and the need to generate the compressed 
output bitstream 126 with the bitstream characteristics 
set by the encoder control data. 

TTie layered encoder 124 operates according to 
encoding control data supplied by the processing selec- 
tion block 120 via the control path 142. The encoding 
control data include header information for the com- 
pressed output bitstream 126. The encoding control 
data depend on processing selections input by the user 
(not shown) into the processing selector 120. 

Like a conventional MPEG encoder, the layered 
encoder 124 includes a number of serially-connected 
encoding nrKXIules that operate together to encode the 
modified bitstream 122. Unlike a conventional MPEG 
encoder, the layered encoder can receive the modified 
bitstream in a partially-compressed state, and can use a 
subset of its encoding modules to encode the partially- 
compressed modified bitstream to the extent required to 
provide the compressed output bitstream with bitstream 
characteristics defined by the encoding control data. 

The encoding control data supplied by the process- 
ing selection module 120 via the control path 142 deter- 
mine the encoding module at which the layered encoder 
begins encoding. When the modified bitstream 122 is 
uncompressed, i.e., the modified bitstream is a conven- 
tional video bitstream having a pixel value for each pixel 
of each picture, the encoding control data set the lay- 
ered encoder to encode the modified bitstream using all 
the encoding modules. However, when the decoded bit- 
stream 116 processed by the decoded bitstream proc- 
essor 118 was only partially decoded by the layered 
decoder 114, the modified bitstream is partially com- 
pressed, and is not a conventional video bitstream. In 
this case, the encoding control data select a subset of 
the encoding modules for the layered encoder to use to 
complete the encoding of the partially-compressed 
modified bitstream. For example, the decoded bitstream 
processor 118 may perform its processing on a 
decoded bitstream 118 composed of blocks of DOT 
coefficients. In this case, the modified bitstream 122 is 
also partially compressed, and the layered encoder 
encodes this modified bitstream by processing the 
blocks of DCT coefficients of the modified bitstream 
without using the spatial bitstream input nrx)dule. the 
motion compensator, the DCT module, and the local 
decoder. 

The encoding modules that constitute the layered 
encoder 124 are based on the corresponding modules 
of a conventional encoder. It is assumed that persons of 
ordinary skill in this art are femiiiar with the structure 



and operation of such conventional encoding modules, 
so the encoding modules will be described only briefly. 
The encoding modules constituting the layered encoder 
include the spatial bitstream input module 313, the 

5 motion compensator 31 1 , the discrete cosine transform 
(DCT) module 309. the quantizer 307. the variable* 
length coder 305. the multiplexer 303. the encoder 
buffer 301 and the local decoder 317. 

In addition to the above-mentioned encoding nrxxJ- 

10 ules, the layered encoder 124 includes the input selec- 
tor 315. the input bus 138 and the encoder bitstream 
parameter bus 1 40. The input selector has an input con- 
nected to the output of the decoded bitstream processor 
118 through which it receives the modified bitstream 

75 1 22. The input selector has an output connected to the 
input bus 138. The input bus is in turn connected to the 
input of each of tiie spatial bitstream input module 313, 
the motion compensator 31 1, tiie DCT module 309, the 
quantizer 307, tiie variable-length coder 305, and the 

20 multiplexer 303. The input selector has a control input 
connected to the control patii 142 through which it 
receives the encoding control data. In response to the 
encoding control data, the input selector determines 
which of the spatial bitsfream input nrnxJule 313, the 

25 motion compensator 311, the DCT module 309, the 
quantizer 307. and the variable-length coder 305 is the 
first of the encoding modules that will process the mod- 
ified bitstream. The input selector then connects the 
input of the first-to-process encoding ntodule to the out- 
do put of the decoded bitstream processor 118 via the 
input bus 138. For example, when the modified beam 
1 22 from the decoded bitstream processor 1 1 8 is a con- 
ventional video bitstream in raster scan format and 
presentation order, tiie input selector 315 connects the 

35 output of the decoded bitstream processor 1 18 to the 
input of the spatial bitstream input module 313. The 
spatial bitstream input module can then convert the 
raster-scan and presentation-order format of the modi- 
fied bitstream into macroblocks and blocks in coding 

40 order for processing by the remaining encoding nxxJ- 
ules of the layered encoder. 

The encoder bitsti-eam parameter bus 140 has 
inputs connected to the output of the bitstream parame- 
ter fbnwarding nrodule 130 and outputs connected to an 

45 additional input on each of the encoding modules SOS- 
SIS. The additional Inputs connected to the encoder bit- 
stream parameter bus enable tiie encoding modules to 
receive the bitstream parameters derived from the com- 
pressed input bitstream by the layered decoder 1 14 and 

50 fonwarded via the bitstream parameter forwarding path 
128. 

In the layered encoder 124. the spatial input bit- 
stream module 313 receives a conventional video bit- 
stream in raster-scan format and presentation order. 
55 and converts the video bitstream into blocks and mac- 
roblocks in coding order suitatrfe for processing by tiie 
remaining encoding modules of the layered encoder. 
The spatial input bitstream module feeds the resulting 
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biock-format video bttstream to the motion compensator 

311. 

The motion compensator 311 determines a motion 
vector for each macroblock of each picture that will be 
encoded as a P-picture or a B-picture. These pictures s 
are the pictures that will not be independently encoded 
as I'pictures. Conventionally, the motion vector for each 
macroblock is determined by performing a block match- 
ing operation between the macroblock and reference 
t)locks selected from one or more reference pictures. 
TTie reference pictures are usually reconstructed pic- 
tures obtained as a result of the local decoder 317 
decoding the bitstream output by the quantizer 307. The 
reconstructed pictures are stored in a multi-page picture 
memory that forms part of the local decoder. 

In a conventional encoder, the block matching oper- 
ation to determine the nrwtion vectors demands the 
most computational resources of any of the operations 
performed by the encoder. However, the computational 
requirements for determining the motion vectors in the 
compressed bitstream processing apparatus 100 are 
substantially reduced or even eliminated by re-using the 
motion vectors derived from the compressed input bit- 
stream 112 by the layered decoder 114 and fonwarded 
to the layered encoder via the bitstream parameter for- 
warding path 128. 

The motion conpensator 311 additionally proc- 
esses the blocks of the pictures that will be encoded as 
P-pictures and B-pictures to generate difference blocks. 
The blocks subject to tills processing will be called pic- 
ture blocks to distinguish them from the reference 
blocks and the difference blocks. The difference block 
for each picture block is obtained by a subtraction oper- 
ation performed between the picture block and a refer- 
ence block. The reference block is tiie block of the 
reference picture indicated by tiie motion vector of the 
picture block. 

The motion compensator 311 also passes encod- 
ing blocks to the DOT module 309. Encoding blocks are 
picture blocks if the picture is to be encoded as an l-pic- 
ture. and are the difference blocks generated as just 
described if the picture is to be encoded as a P-picture 
or a B-picture. 

The OCT module 309 receives ttie encoding blocks 
from the motion compensator 311 and orthogonally 
transforms each encoding block from the spatial domain 
to the frequency domain using a discrete cosine trans- 
form. The DOT module passes tine resulting blocks of 
DCT coefficients to the quantizer 307. 

The quantizer 307 receives the blocks of DCT coef- 
ficients from the DCT module 309 and quantizes each 
of the DCT coefficients in each block. The quantizing 
step-size is comrolled by a buffer occupancy control sig- 
nal (not shown) generated by the encoder buffer 301. 
The quantizing step size is conf died to ensure that the 
encoder buffer and a hypothetical standard video 
decoder buffer neittier overflow nor underftow. The 
quantizer passes the resulting blocks of quantized DCT 



coefficients to the variable-length coder 305. 

The variable-length coder 305 receives the blocks 
of quantized DCT coefficients from the quantizer 307 
and applies variable-length coding to the quantized 
DCT coefficients in each block. The variable-lengtii 
coder passes the resulting blocks of coded quantized 
DCT coefficients to tiie multiplexer 303 and to the local 
decoder 31 7. 

The multiplexer 303 receives the blocks of coded 
quantized DCT coefficients from tiie variable-iengtti 
coder 305. and additionally receives parameters such 
as motion vectors from tiie motion compensator 311. 
quantizing step size information from tiie quantizer 307. 
and run-length information from tiie variable-length 
coder 305. and combines ttiese parameters to generate 
a picture-layer video bitstream. The multiplexer passes 
tiie resulting video bitstream picture-by-picture to the 
output buffer 301. 

The output buffer 301 receives tiie video bitstream 
from the multiplexer 303 and generates the compressed 
output bitstream 126, a constant bit-rate bit stream. An 
additional multiplexer (not shown) may interleave the 
compressed output bitsti'eam with other brtstreams. 
such as a compressed audio bitstream, and with addi- 
tional header information, to generate a composite out- 
put bitsti-eam. 

The spatial bitstream input module 313, tiie motion 
compensator 31 1 . the DCT module 309, the quantizer 
307 and the variable-iengtti coder 305 operate selec- 
tively in response to ttie encoding control data received 
from the processing selection module 120 via the con- 
t-ol path 142. The encoding control data determine 
whether each of the above modules will actually oper- 
ate. For exanple, if tiie user desires to perform spatial 
filtering on the compressed input bitstream. and ttie 
decoded bitsfream processor is capable of performing 
such filtering on DCT coefficients, ttie encoding control 
data will enable tiie quantizer 307 and the variable- 
lengtii coder 305 and will cause the input selector 31 5 to 
connect the partially-compressed nrxxlified bitstream 
122 from the decoded bitsti'eam processor 1 18 to tiie 
input of tiie quantizer 307. The encoding control data 
will also deactivate tiie encoding nxxfules upstream of 
the encoding module that receives the modified bit- 
stream, i.e., the DCT module 309, the motion compen- 
sator 311. ttie spatial bitstream input module 313 and 
tiie local decoder 317. Deactivating tiie unused encod- 
ing modules frees computational resources that would 
othenwise be used to provide tiiese nrxxlules to be used 
for otiier purposes. 

It should be noted tiiat when the compressed bit- 
stream processing apparatus according to tiie Invention 
Is embodied in a computer or digital signal processor, 
the computer or digital signal processor may lack such 
elements as the input bus 138 and ttie encoder bit- 
stream parameter bus 140. In this case, tiie input selec- 
tor 315 may communicate the addresses at which the 
decoded bitstream processor 118 stored ttie modified 
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bitstream 122 to the first of the encoding modules to 
process the modified bitstream. This encoding module 
will then fetch the modified bitstream from these 
addresses. Similarly, the bitstream parameter forward- 
ing module 130 may communicate to the layered $ 
encoder 124 the addresses at which the bitstream 
parameters derived from the compressed input bit- 
stream 1 12 by the layered decoder 1 14 are stored. The 
layered encoder can then fetch the bitstream parame- 
ters stored at these addresses to use them in connec- io 
tion with encoding the modified bitstream. It should also 
be noted that, in computer-based and DSP-based 
embodiments, the encoding modules may be ephem- 
eral, and the apparatus will tack elements conrespond- 
ing to the encoding nfiodules that are not used to encode is 
the modified bitstream 122. 

Some of the ways in which the bitstream parame- 
ters derived from the compressed input bitstream 112 
by the layered decoder 114 can be used will now be 
desaibed. In a first example, the bitstream parameters 20 
derived from the compressed input bitstream are for- 
warded to the decoded bitstream processor 118 where 
they are used to simplify the processing performed by 
the decoded bitstream processor. The bitstream param- 
eters are color data indicating the color characteristics 25 
of the video signal represented by the conpressed input 
bitstream. Such color data are included in the picture 
headers derived from the compressed input bitstream 
by the demultiplexer 203. The demultiplexer fonwards 
the color data to the decoded bitstream processor 118 30 
via the bitstream parameter fonwarding path 128. The 
decoded bitstream processor then uses the color data 
to determine whether it needs to apply color correction 
to the decoded bitstream 116. if the decoded bitstream 
processor determines that color correction is needed, it 3S 
may additionally use the color data to design an appro- 
priate color calibration scheme. 

The layered decoder 114 decodes the compressed 
input bitstream 1 12 to generate the decoded bitstream 
116 in a compression state suitable for processing by 40 
the decoded bitstream processor 1 18. The decoded bit- 
stream processor then applies color correction to the 
decoded bitstream using the color calibration scheme it 
has derived from the color data derived from the com- 
pressed input bitstream. The layered encoder 124 then 4s 
re-encodes the modified bitstream 122 generated by 
the decoded bitstream processor 118 to generate the 
compressed output bitstream 126. The video signal rep- 
resented by the compressed output bitstream is color 
corrected relative to that represented by the com- so 
pressed input bitstream. Additional bitstream parame- 
ters derived from the compressed input bitstream 112 
may be used by the layered encoder to simplify the 
encoding processing required to re-encode the nuxJif ied 
bitstream 122, as will be described below. ss 

As noted above, in conventional MPEG compres- 
sion, the motion estimation operation of the encoding 
process requires the wosX computational resources. 



Motion estimation is conventionally performed using a 
motion compensator module located in the encoder in a 
position corresponding to that of the motion compensa- 
tor 311 in the layered encoder 124. Consequently, elim- 
inating or sut>stantially simplifying the motion estimation 
operation can achieve substantial savings in the compu- 
tational resources required by the layered encoder 124. 

The motion compensator 311 can be completely 
disabled if the decoded bitstream processor 118 can 
perform the processing operations selected by the user 
using the DCT coefficients derived from the com- 
pressed input bitstream 112 by the layered decoder 
114. This provides a suk>stantial reduction in the compu- 
tational resources demanded by the layered encoder. 
However, if the processing operation performed by the 
decoded bitstream processor 118 requires tiiat tiie lay- 
ered decoder fully decode tiie compressed input bit- 
stream to provide a conventional video bitstream as the 
decoded bitstream 116. then the modified bitstream 122 
is a conventional video bitstream that has to be fully re- 
encoded. 

The oonrpressed bitstream processing apparatus 
100 provides a number of ways of redudng the compu- 
tational resources required to re-encode the modified 
bitstream when the modified bitstream is a conventional 
video bitstream. The bitstream parameter fonwarding 
path 128 fonvards the motion vectors derived from the 
compressed input bitstream 1 12 to the layered encoder 
124. The layered encoder can then use these motion 
vectors as the motion vectors in the motion compensa- 
tion operations performed by the motion compensator 
311. This provides a significant reduction in the compu- 
tational resources required by tiie layered encoder 124. 
since no motion estimation operations are performed. 
Re-using tiie motion vectors derived from the com- 
pressed input bitstream consbBins the performance of 
tiie motion estimation in tiie layered encoder to be no 
better than tiiat originally used to encode the com- 
pressed input bitstream. However, this is not usually a 
significant drawt>ack since most hardware or software 
encoders employ an effective although efficient motion 
estimation algorithm. 

Simply re-using the motion vectors derived from the 
compressed input bitstream 1 12 will produce an accept- 
able motion estimation accuracy, but a better motion 
estimation accuracy is obtained by using tiie motion 
vectors derived from tiie compressed input bitstream as 
full -pixel nfK>tion vectors, and performing an additional 
half-pixel search relative to the full-pixel motion vectors 
to produce the final motion estimation. This alternative 
demands more conputational resources tiian re-using 
the motion vectors derived from the original com- 
pressed input bitstream. However, it produces a better 
picture quality and a better compression efficiency. 
Moreover, since the scope of the motion estimation 
search is considerably less than tiiat used in conven- 
tional motion estimation, tiie additional computing 
resources required are substantially less than those 
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required for conventional motion estimation. 

An example of the structure of the motion compen- 
sator 311 that performs local motion estimation is 
shown in Rgure 4. Ttie motion compensator includes 
the local motion essimator 441 and the subtractor 443. s 
The local motion estimator has inputs connected to the 
outputs of the spatial bitstream input module 313, the 
encoder bitstream parameter bus 140, and the local 
decoder 317. The local motion estimator has outputs 
connected to the reconstructed picture memory 445 in 
the local decoder, the encoder bitstream parameter bus 
and both inputs of the subtractor 443. 

The local motion estimator 441 receives successive 
picture blocks from the spatial bitstream input module 
313 and performs a motion estimation operation on 
each of them. The picture block that is the subject of the 
current motion estimation operation will be called the 
current picture block. The local motion estimator also 
receives the motion vector for the cun'ent picture block 
from the encoder bitstream parameter bus 140. This 
motion vector was derived from the compressed input 
bitstream 112 as a bitstream parameter, and was for- 
warded via the bitstream parameter fonvarding path 128 
(Figure 2). The local motion estimator derives an 
address from the fonwarded motion vector for the cur- 
rent picture block, and supplies this address to the pic- 
ture memory 445 of the local decoder 31 7. In response, 
the picture memory feeds a super reference block back 
to the k>cal motion estimator. The super reference block 
is a block of a reconstructed picture stored at the loca- 
tion in the picture memory designated by the address, 
and is two pixels larger than a conventional picture block 
in both the horizontal and vertical directions. The larger 
size of the super reference block enables matching 
blocks having a half-pixel precision to be generated 
from the super reference block. 

The local motion estimator 441 performs Interpola- 
tton operations between adjacent pixel values in the 
super reference block to generate a set of eight 8x8 
pixel matching blocks. Each matching block is displaced 
relative to the center of the super matching block In a 
different one of the directions N, NE. E, SE, S, SW, W, 
N W by a distance equivalent to one half of the distance 
between adjacent pixels in the super reference block. 
The local motion estimator also generates a ninth 
matching block by selecting an 8 x 8 pixel picture block- 
sized subset centered in the 10 x 10 pixel super refer- 
ence block. 

The local motion estimator 441 then performs a 
block matching operation between the current picture 
block and the nine matching blocks to determine which 
matching block most closely matches the current pic- 
ture block. This matching block will be called the ctosesX 
matching block. The local motion estimator then adds 
the displacement of the closest matching block relative 
to the fonwarded motion vector to tiie fonwarded motion 
vector to generate a new motion vector with half-pixel 
precision for the current picture block. The local motion 



estimator also adopts the closest matching block as the 
reference block for the current picture t>lock. 

The local motion estimator 441 feeds the new 
motion vector with half-pixel precision to the encoder 
bitstream parameter bus 140 for forwarding to the 
encoder buffer 301 . and feeds the current picture block 
and its reference block to the inputs of the subtracter 
443. The subtractor 443 performs a pixel-by-pixel sub- 
traction of tiie reference block from the cun'ent picture 
block, and feeds the resulting difference block to the 
DOT module 409. 

Bitstream parameters derived from the compressed 
input bitstream 112 may also be used to reduce the 
computational requirements of the bit rate control per- 
formed by the layered encoder 124. Bit rate control 
plays an important r6le in achieving good video quality 
and helps ensure that the compressed output bitstream 
126 can be decoded in real time by a practical decoder. 
Bit rate control controls the number of bits allocated to 
encode each picture. The number of bits allocated to 
encode each picture must not only quantize all the DCT 
coefficients in the picture with a sufficient number of 
quantizing levels to achieve an acceptable presentation 
quality, but must also satisfy the buffer overflow and 
underflow constraints defined by the MPEG standard. 

The compressed input bitst-eam 112 contains bit- 
stream parameters indicating the characteristics of 
each maaoblock. The layered decoder 1 14 can derive 
such bitstream parameters from tiie compressed input 
bitstream. and pass them to the layered encoder 124 
where they are re-used to assist in performing the adap- 
tive bit allocation. Examples of two different approaches 
to re-allocating bits to the DCT coefficients of each mac- 
roblock will be described witii reference to Figures 3. 5 
and 6. 

In the first approach, illustrated in Figure 5, the lay- 
ered decoder 114 derives the quantizing step size 
''^mquantI^] ^^^^ compressed input bitstream 1 12. 
The quantizing step size /^mquantI'^I 's the quantizing 
step size of the current macroblock k in the compressed 
input bitstream. The layered decoder passes the quan- 
tizing step size to tiie layered encoder as a bitstream 
parameter. The quantizing step size is also passed to 
the inverse quantizer 207, which performs an inverse 
quantizing operation on the DCT coefficients in the cur- 
rent macroblock k using tills quantizing step size. Then, 
in tiie layered encoder 124. the quantizer 307 calculates 
a new quantizing step size MQUANT[/c] for quantizing 
the DCT coefficients of the cunrent macroblock k and re- 
quantizes the DCT coefficients of the current macrob- 
lock k with the new quantizing step size. The quantizer 
calculates the new quantizing step size MQUANTI^] 
using the quantizing step size for the current maaob- 
lock k fonivarded from the compressed input bitstream. 

In the second approach, illustrated in Figure 6, the 
quantized DCT coefficients for the current macroblock k 
are derived from the compressed input bitstream by the 
inverse variable-length coder 205 and fonwarded 
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through the bitstream parameter forwarding path 128 
from the layered decoder 1 1 4 to the quantizer 307 of the 
layered encoder 124. Also, the bitstream parameter 
mbincoed^] indicating the number of non-zero OCT 
coefficients In the current macroblock Is derived from 5 
the compressed Input bitstream and forwarded from the 
layered decoder to the quantizer in the layered encoder. 
Using the bitstream parameter mbincoeM' ^he quan- 
tizer then performs an operation that nulls out selected 
ones of the non-zero quantized DCT coefficients such 
that the compressed output bitstream meets the above- 
mentioned buffer constrains. 

Nulling out selected non-zero quantized DCT coef- 
ficients in the second approach demands fewer compu- 
tational resources than the first approach because 
Inverse quantizing and re-quantizing are not performed. 
However, the first approach will usually provide a better 
presentation quality. 

The computational resources required by the first 
approach are reduced by using bitstream parameters 
derived from the compressed Input bitstream to enable 
the adaptive bit allocation of the compressed input bit- 
stream to assist in controlling the bit rate of the com- 
pressed output bitstream. The processing performed in 
the first approach Is illustrated in Figure 5. In the follow- 
ing description, the block of DCT coefficients that is the 
subject of the current quantizing operation will be called 
the current block, and the picture of which the cunrent 
block forms part will be called the current picture. 

At the start of encoding, steps SI and S2 are per- 
formed. In step SI , the layered decoder 1 1 4 derives the 
bitstream parameter from the compressed input bit- 
stream 1 1 2 and fonvards this bitstream parameter to the 
quantizer 307 via the bitstream parameter forwarding 
path 128. The bitstream parameter fl/^ indicates the bit 
rate of the compressed input bitstream. In step S2. the 
quantizer 307 in the layered encoder 124 receives the 
bitstream parameter R^, from the encoder bitstream 
parameter bus 140. and receives the parameter Ro^^ 
from the processing selection module 120. The quan- 
tizer then determines the ratio bitSf^tioo by dividing Rouf 
by fli,. 

In step S3, the inverse variable-length coder 203 
derives the bitstream parameter /n|^m/^N-f(/(] from each 
macroblock in the compressed Input bit stream 112. 
The bitstream parameter /nMouANjC^] oi the cun-ent 
macroblock k of the compressed input bitstream indi- 
cates the quantizing step size that was used to quantize 
the DCT coefficients of the current macroblock k. The 
inverse variable-length coder forwards the bitstream 
parameter //^mquantI^] ^ quantizer 307 In the lay- 
ered encoder 124. 

In step S4. the inverse variable-length coder 203 
derives the bitstream parameter inbitslk] for the currerrt 
macroblock k by counting the number of bits in the com- 
pressed input bitstream used to represent the DCT 
coefficients of the current picture prior to the DCT coef- 
fteients of the current maaoblock k. The Inverse varia- 



ble-length coder forwards the bitstream parameter 
inbits[k] to the quantizer 307 in the layered encoder 
124. 

In steps S5-S8. the quantizer 307 in the layered 
encoder 124 uses the bitstream parameters forwarded 
by the layered decoder 1 1 4 to quantize the DCT coeffi- 
cients in the current macroblock with a quantizing step 
size that enables the bit rate of the compressed output 
bitstream 126 to comply with the above-mentioned 
buffer constraints. The variakrfe-length coder 305 
includes a counter that counts outbits[k], the number of 
bits of the compressed output bitstream used to repre- 
sent the DCT coefficients of the cunrent picture prior to 
the DCT coefficients of the current macroblock k. The 
variable-length coder feeds each value of outbitslk] 
back to the quantizer. Finally, the quantizer receives 
encoding control data via the control path 142. 

In step S5, the quantizer determines the ratio 
bitSratioW by determining the ratio between outbitslk] 
and inbitslkl i.e.: 

bitSfgffglk] s outbitslkjinbitslk] 

In step S6. the quantizer 307 determines the con- 
version factor flk] for the current macroblock k. The 
quantizer calculates the conversion factor from the 
ratios biiSratioW and u^i"9 following equa- 

tion: 

.j^, bits ^ti^lk]^ bits ^t^o 
^ bits^^lk]^2xbits„^o 

where 0.7 ^ [/c] ^ 1.3. 

In step 87. the quantizer 307 calculates the value of 
MQUANT[/c] for the current macroblock k. The value of 
MQUANT[/c] is the quantizing step size that the quan- 
tizer will use to quantize the DCT coefficients of the cur- 
rent macroblock k. The quantizer calculates the value of 
MQUANT[/c] for the current macroblock k by multiplying 
the value of the bitstream parameter /^mquan-K^] by the 
conversion foctor f[k], i.e.: 

MQUANTI^f] = in^ouAf^lk] x f[k]. 

In step S8. the quantizer 307 quantizes all the non- 
zero DCT coefficients in the current macroblock k using 
the quantizing step size MQUANT[/c]. 

In step 89, the quantizer determines whether all the 
macroblocks in the current bitstream have been quan- 
tized. If so. proceiling proceeds to step S10. where it 
ends. Othenvise, processing retums to step S3 and the 
process of calculating the ratio bitSrsthW, the conver- 
sion factor f[k] and the quantizing step size MQUANT[^] 
for the next macroblock k, and quantizing the DCT coef- 
ficients of the next macroblock using the quantizing step 
size MQUAfsTTI/c] is repeated until the picture is com- 
pletely coded, and until the entire compressed input bit- 
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stream has been processed. 

The computational resources required for the sec- 
ond approach are also reduced by using bitstream 
parameters derived from the compressed input bit- 
stream to enable the adaptive bit allocation of the com- s 
pressed Input bitstream to assist In controlling the bit 
rate of the compressed output bitstream. The process* 
ing performed in the second approach is illustrated in 
Figure 6. Steps S1 . S2, S4-S6. and S9 are the same as 
in the first approach described above whh reference to io 
Figure 5. and will not be described again here. 

In step S3, the layered decoder 1 1 4 derives the bit- 
stream parameter mb/^xveffl^l ®^ch macroblock of the 
compressed input bitstream 112 and fbnwards this bit- 
stream parameter to the quantizer 307 in the layered 15 
encoder 124 via the bitstream parameter fonn^rding 
path 128. The bitstream parameter mbjncoed^] indi- 
cates the number of non-zero DCT coefficients in the 
cunrent macroblock /c of the compressed input bit- 
stream. 20 

In step S5A. the layered decoder 1 14 fonwards the 
quantized DCT coefficients derived from the com- 
pressed input bitstream 112 by the inverse variable- 
length coder 205 to the quantizer 307 via the bitstream 
parameter fonwarding path 1 28. 25 

In step S7, the quantizer 307 in the layered encoder 
124 uses the bitstream parameter mbipcQ^f/lk] to deter- 
mine the number of the quantized DCT coefficients 
received from the layered decoder that will be set to 
zero to control the bit rate of the compressed output bit- 30 
stream. The quantizer calculates the value of 
mboutcoeM ^or the current macroblock k. The value of 
^^outcoefW 'S the number of DCT coefficients in the 
macroblock k that may have a value other than zero. To 
calculate the value of mboutcoofM current mac- 35 
roblock k, the quantizer multiplies the value of the bit- 
stream parameter mbincoBfAl^] by the value of the 
conversion factor ([k] calculated in step SB, i.e.» 

^cutcoeffW = nib^ffW X f[ky 40 

In step S8, the quantizer 307 receives all the quan- 
tized DCT coefficients of the current macroblock k from 
the inverse variable-length coder 205, and sets to zero 
all but the number of them indicated by the value of 45 

In the embodiment just described, the compressed 
input signal and the compressed output signal were 
both MPEG-conrpliant bitstreams. An example of a sec- 
ond embodiment 700 of a compressed bitstream so 
processing apparatus according to the invention will 
now be described with reference to Figures 7A and 7B. 
This embodiment operates on a compressed input bit- 
stream in any compression state, generates the com- 
pressed output bitstream in any compression state, end 55 
allows multiple processors operating on bitstreams hav- *~ 
ing different compression states to be concatenated. In 
the example to be described, the compressed bitstream 



processing apparatus processes a compressed input 
bitstream representing a video signal. 

The compressed bitstream processing apparatus 
700 is composed of four basic units, the first compres- 
sion state translation unit 714. the final compression 
state translation unit 724. the processor 718A, and the 
bitstream parameter fbnvarding path 728 that includes 
the bitstream parameter forwarding module 730, If the 
compressed bitstream processing apparatus is 
designed to allow a user to select or define the process- 
ing operation performed, the apparatus additionally 
includes the processing selection module 720 that 
receives instructions from the user and controls the 
processing performed by the compresston state transla- 
tion units and the processor. Othenvise. the processing 
selection module controls the processing performed by 
the compression state translation units and the proces- 
sor so that the compressed bitstream processing appa- 
ratus performs a predetermined processing operation 
on the compressed input bitstream. 

The example shown in figure 7A includes two 
optional additional units, the compression state transla- 
tion unit 71 4B and the second processor 71 8B. These 
additional units provide the conpressed bitstream 
apparatus 700 with the capability to process the Infor- 
mation signal represented by the compressed input bit- 
stream in two different ways, a first way performed by 
the first processor 71 8A and a second way performed 
by the processor 7188. The compression state transla- 
tion unit 7148 precedes the optional second processor ' 
7188, and the two units are interposed between the first 
processor 71 8 A and the final compression state transla- 
tion unit 724. The compression state translation unit 
7148 and the second processor are also connected to 
the bitstream parameter fonvarding path 728 and are 
controlled by the processing selection unit 720. 

Preceding the second processor TISB with the 
compression state translation unit 7l48^^^2abi^_tb.e^ 
second processor to operat e on a bitstr6am havino -a. 
Bffferen t compi^essfon'gtate'from th e bitstream output by 
the first pro cessor ; 71 8A7DptiorTally. more than one 
additional processor, each preceded by a compression 
state translation unit, may be interposed between the 
first processor 71 8A and the final compression state 
translation unit 724. 

In the example shown in figure 7A, the video signal 
represented by tiie compressed input bitstream 712 is 
subject to two different processing operations, one per- 
formed by the first processor 71 8A and the other per- 
formed by the second processor 7188. The first 
processor is preceded by the compression state t"ans- 
lation unit 71 4A. which changes the compression state ' 
of the compressed input bitstream to generate the out- 
put bitstream 71 6A jn t he oonff)ression slate required by 
the first proce ssor. The first compression state transla- 
tion unit enables the compressed input bitstream 712 to 
have a compression state that differs from that required 
by the first processor. 
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The first processor 71 8A processes the output bit- 
stream 71 6A generated by the compression slate trans- 
lation unit 71 4A to generate the modified bitstream 
722A. The first processor modifies the video signal rep- 
resented by the output bitstream 71 6A, but does not 5 
change the compression state of the output bitstream. 
Consequently, the compression state of the modified 
bitstream 722A is the same as that of the output bit- 
stream 71 6A. Optionally, the first processor 71 4A may 
be composed of multiple concatenated processors, all 
of which operate on bitstreams in the same compres- 
sion state. 

The second processor 71 8B Is preceded by the 
compression state translation unit 714B. which changes 
the compression state of the nrKxiif ied bitstream 722A to 
generate the output bitstream 716B in the compression 
state required by the second processor. The compres- 
sion state translation unit 7148 enables the second 
processor to be concatenated with the first processor 
71 8A, even though the processas operate on input bit- 
streams having differing compression states. 

The second processor 71 SB processes the output 
bitstream 71 6B generated by the compression state 
translation unit 71 4B to generate the modified bitstream 
722B. The second processor modifies the video signal 
represented by the output bitstream 71 6B, but does not 
change the conpression state of the output bitstream. 
Consequently, the compression state of the modified 
bitstream 722B is the same as that of the output bit- 
stream 71 6B. Optionally, the second processor may 
also be composed of multiple concatenated processors, 
all of which operate on bitstreams in the same compres- 
sion state. 

The second processor 71 8B is followed by the final 
compression state translation unit 724, which changes 
the compression state of the modified bitstream 722B to 
generate the compressed output signal 726. This ena- 
bles the compressed bitstream processing apparatus 
700 to deliver the compressed output signal in the 
desired compression state. The final compression state 
translation unit may also change the bitstream charac- 
teristics, e.g., bit rate, buffer size, etc.. of the modified 
bitstream to generate the compressed output bitstream 
with the desired bitstream characteristics. TTie com- 
pression state and bitstream characteristics of the com- 
pr^s^d-outpiit signal may be the same as. or different 
fj;(^Mhat of the compressed input bitstream 712. 

\Figure T^shows details of the compression state 
translktierrtjnit 714 having the same structure and oper- 
ation as the compression state translation units 71 4A. 
71 4B and 724 of the embodiment shown in Rgure 7A. 
The compression state translation unit 714 receives the 
Input bitstream 712 in a first compression state, selec- 
tively changes the compression state of the input bit- 
stream to generate the output bitstream 716 having a 
different compression state from the input bitstream. 
The compression state of the output bitstream may be 
greater than or less than that of the input bitstream, i.a. 



the compression state translation unit 714 may operate 
in an encoding mode or a decoding mode, depending 
on the control data received via the control path 732. 

The compression state translation unit 714 Is com- 
posed of three main modules, the input interface 719, 
the output interface 721, and the layered encod- 
ing/decoding modules 723. TTie layered encod- 
ing/decoding modules are composed of an 
encoding/decoding module con^esponding to each com- 
pression state of the compressed Input bitstream. In the 
example shown, the layered encoding modules are the 
variable length codingAJecoding module 705, the quan- 
tizing/inverse quantizing module 707, the orthogonal 
transform module 709 and the motion compensa- 
tion/spatial processing module 71 1 . 

The Input interface module 719 Includes buffering 
and demultiplexing elements (not shown) that derive bit- 
stream parameters from the Input bitstream 712. The 
input interface module selectively feeds the bitstream 
parameters to those of the layered encoding/decoding 
nrKXfules 723 that requre them via the input bus 738. 
The input bus enables the input interface module to feed 
bitstream parameters to any of the encoding/decoding 
nxxiules. The control data received via the control path 
732 determine which of the encoding/decoding mod- 
ules receive the bitstream parameters from the input 
bus. 

The Input interface nrxxjule 719 also feeds the bit- 
stream parameters to the bitstream parameter forward- 
ing bus 736 for fbnwarding to the processors 71 8A and 
71 SB and to other compression state translation units 
via the bitstream parameter fonwarding path 728. The 
control data received via tiie control path 732 determine 
which of tiie bitstiream parameters are fed to the bit- 
stream parameter fbnvarding bus 736. 

The bitstreams generated by the layered encod- 
IngAdecoding nrvxlules 723 are fed to the data output 
bus 725. These bitstreams are composed of such data 
elements as pixel values, motion vectors, coded, quan- 
tized DOT coefficients, etc. The data output bus trans- 
fers these bitstreams to an encoding/decoding module 
of a higher or lower layer, and also to the output inter- 
face module 721 . 

The output interface mo6{Ae 721 includes multiplex- 
ing and buffering elements (not shown) that construct 
the output bitstream 716 from the bitstreams generated 
by one or more of the layered encoding/decoding mod- 
ules 723. The output interface module can select the bit- 
stream output by any of ttie encoding/decoding 
modules for inclusion in the output bitstream. The out- 
put interface module selects the encoding/decoding 
modules from to receive a bitstream for inclusion in the 
output bitstream in response to the control data 
received via the control path 732. 

The layered encoding/decoding modules 723 are 
all dual-function modules. Each of the modules is capa- 
ble of operating in an encoding mode or in a decoding 
mode, depending on the control data received via the 
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control path 732. For example, when the control data 
set the orthogonal transform module 709 to its encoding 
mode, this module performs both fonward and reverse 
discrete cosine transforms, the inverse transforms 
being required to provide part of the local decoding 5 
function of an encoder. When the control data set the 
orthogonal transform module to its decoding mode, this 
module only perfbrms inverse discrete cosine trans- 
forms. 

The control data received via the control path 732 
also select the encoding/decoding modules required to 
provide the compression state translation unit with its 
desired compression state translation characteristic. 
The control data may select all of the encoding/decod- 
ing modules, or a subset of the encoding/decoding 
modules, depending on the conpression states of the 
input and output bitstreams. 

In a computer- or DSP-based compressed bit- 
stream processing apparatus, the control data received 
via the control path 732 also determine the allocation of 
computational resources to each of the layered encod- 
ing/decoding modules 723. The compression state 
translation unit performs a partial encoding or decoding 
operation using a subset of the layered encod- 
ing/decoding nrxxlules. Normally, in this case, no com- 
putational resources are allocated to the remaining, 
unused encoding/decoding modules. 

Each of the encoding/decoding modules 723 oper- 
ates on a bitstream output by either the input internee 
nKxfule 71 9 or the encoding/decoding module in at least 
one higher or lower processing layer. Each of the 
encoding/decoding modules outputs a bitstream to the 
output interface module 721 or to the encoding/decod- 
ing nxxiule in at least one higher or lower processing 
layer. The tntstream routing among the encod- 
ing/decoding modules and between the input and out- 
put interface modules 719 and 721 and the 
encoding/decoding modules is determined by the con- 
trol data received via the control path 732. Whether a 
bitstream is output to a encoding/decoding module in a 
higher layer or a lower layer depends on whether the 
compression state translation unit is operating in its 
encode mode or its decode mode, respectively. 

In addition, the layered encoding^ecoding modules 
723 may operate using bitstream parameters received 
via the bitstream parameter fonwarding path 728, and 
the layered encoding/decoding modules may addition- 
ally or alternatively derive bitstream parameters from 
the compressed input bitstream and forward such bit- 
stream parameters to the other compression state 
translation units and the processors via the bitstream 
parameter forwarding path 728. 

A first practical example of a compression state 
translation unit will now be described. In this example, 
the compression state translation unit is the first com- 
pression state translation unit 714A of a compressed 
bitstream processing apparatus in which the first proc- 
essor 71 8A operates on a partially-compressed bit- 



stream composed of DCT coefficients. In this example, 
the input bitstream 712 of the first compression state 
translation unit is an MPEG bitstream, and the first com- 
pression state translation unit operates to decode the 
MPEG bitstream to the compression state required by 
the first processor. 

Control data received via the control path 732 
cause the compression state translation unit 71 4A to 
operate in the following way: the variable-length cod- 
ing/decoding module 705 operates in its variable-length 
decoding mode, the quantizing/inverse quantizing mod- 
ule 707 operates in its inverse quantizing mode and the 
remaining encoding/decoding modules are disabled. No 
computational resources are allocated to the disabled 
encoding/decoding modules. 

The input interface nrxxiule 719 derives coded, 
quantized DCT coefficients, quantizing tables, motion 
vectors, picture headers and other bitstream parame- 
ters from the input bitstream 712. Using the input bus 
738, the input interface module feeds the DCT coeffi- 
cients to the variable-length decoding module 705, the 
quantizing tables to the inverse quantizing module 707, 
and the motion vectors and picture headers to the out- 
put interface module 721 . Using the bitstream parame- 
ter forwarding bus 736, the input interlace module also 
feeds the quantizing tables, motion vectors, picture 
headers and other bitstream parameters derived from 
the input bitstream to the bitstream parameter forward- 
ing path 728 and to the output interlace module 721. 

The output interface nxxfule 721 receives via the 
output bus 725 the bitstream of DCT coefficients output 
by the inverse quantizing module 707. The output inter- 
face module receives via the fonvarded bitstream 
parameter bus 736 a bitstream composed of the 
respective picture headers and motion vectors from the 
input interface module 719. The output interface module 
fbrms the output bitstream 716 from the DCT coeffi- 
cients and the respective picture headers and motion 
vectors. 

The bitstream parameters derived from the input 
bitstream 712 by the first compression state translation 
unit 71 4A are fonwarded via the bitstream forwarding 
path 728 to the first and second processors 71 8A and 
71 8B for use in processing the output bitstream gener- 
ated by the compression state translation unit 71 4A. 
The bitstream parameters are also fbnwarded via the bit- 
stream fbnwarding path 728 to the compression state 
translation units 71 4B and 724 for possible use in re- 
encoding the nxxjif ied bitstreams generated by the first 
and second processors. 

A second practical exanple of a compression state 
translation unit will now be described. In this example, 
the compression state translation unit is again the first 
compression state translation unit 714A of a com- 
pressed bitstream processing apparatus 700 In which 
the first processor 71 8A operates on a partially-com- 
pressed bitstream composed of DCT coefficients. In this 
second example, the input bitstream 712 Is a partially 
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compressed bitstream composed of pictures in coding 
order, and in which each picture is composed of a set of 
encoding blocks. Encoding blocks are picture blocks 
composed of a pixel value for each pixel when the pic- 
ture is a l-picture, and are difference blocks composed 
of a difference value for each pixel when the picture is a 
p. or B-picture. In the latter case, each encoding block 
has a respective motion vector. The compression state 
translation unit operates 71 4A to encode the partially- 
compressed input bitstream to change the conrpression 
state of the input bitstream to that required by the first 
processor. 

Control data received via the control path 732 
cause the compression state translation unit 71 4A to 
operate in the following way: the orthogonal transform 
module 709 operates in its fonward transform mode, and 
the remaining encoding/decoding modules are disa- 
bled. No computational resources are allocated to the 
disabled encoding/decoding modules. 

The input interface module 719 derives the encod- 
ing blocks, motion vectors and other bitstream parame- 
ters from the input bitstream. Using the input bus 725. 
the input interface module feeds the encoding blocks to 
the orthogonal transform module 709. The input inter- 
face module also feeds the motion vectors and other bit- 
stream parameters derived from the input bitstream to 
the bitstream parameter fbnwarding bus 736 for fonA/ard- 
ing to the bitstream parameter forwarding path 728 and 
to the output interface module 721 . 

The output interface module 721 receives via the 
output bus 725 the bitstream of DCT coefficients output 
by the orthogonal transform module 709. The output 
interface module also receives via the bitstream param- 
eter fonvarding bus a bitstream composed of the 
respective motion vectors for the DCT coefficients from 
the input interface module 719. The output interface 
module forms the output bitstream 716 from the DCT 
coefficients and respective motion vectors. 

Again, the bitstream parameters derived from the 
input bitstream 712 by the first compression state trans- 
lation unit 71 4A are fonwarded via the bitstream forward- 
ing path 728 to the first and second processors 71 8A 
and 71 8B for use in processing the output bitstream 
generated by the compression state translation unit 
71 4A. The bitstream parameters are also fonwarded via 
the bitstream forwarding path 728 to the compression 
state translation units 714B and 724 for possible use in 
further changing the compression state of the modified 
bitstreams generated by the first and second proces- 
sors. 

In both examples just described, fbnwarding the bit- 
stream parameters from the first compression state 
translation unit 71 4A saves the compression state 
translation units 71 4B and 724 from expending compu- 
tational resources to generate new parameters equiva- 
lent to the bitstream parameters fonwarded by the 
compression state translation unit 71 4A. Consequently, 
the compressed bitstream processing apparatus 700 



according to the invention can perform the desired 
processing of the compressed input bitstream using a 
smaller scale of hardware or a less powerful computer 
or digital signal processor than a conventional com- 

5 pressed information signal processing Eipparatus. Alter- 
natively, compared with a conventional processing 
apparatus, the compressed bitstream processing appa- 
ratus 700 can perform the desired processing at a faster 
rate, e.g., faster than real-time, using given hardware or 

10 a given computer. 

Although this disclosure describes illustrative 
embodiments of the invention in detail, it is to be under- 
stood that the inventton is not limited to the precise 
embodiments desaibed. and that various modifications 

15 may be practiced within the scope of the invention 
defined by the a|:^ended claims. 

Claims 

20 1 . Apparatus (1 00. 700) for processing a compressed 
input bitstream representing on information signal, 
the apparatus comprising: 

a layered decoder (114; 714) that decodes the 

25 compressed input bitstream (112, 712) to pro- 

vide a decoded bitstream (116, 716A), the lay- 
ered decoder including serially-connected 
decoding modules (e.g., 201, 203. 705, 707), 
each having an output; 

30 a decoded bitstream processor (118, 71 8A) 

that processes the decoded bitstream in a way 
that modifies the information signal to provide a 
modified bitstream (122. 722A), the decoded 
bitstream processor having an input and an 

35 output; 

a layered encoder (124. 724) that re-encodes 
the modified bitstream to provide a com- 
pressed output bitstream (126, 726). the lay- 
ered encoder including serially-connected 

40 encoding modules (e.g.. 301. 303; 705. 707), 

each of the encoding modules having an input, 
each of the encoding modules corresponding 
to one of the decoding modules of the layered 
decoder: and 

4S a selective interconnection path (134, 215. 

315, 138: 725. 721. 719, 738) that selectively 
connects the output of one of the decoding 
modules to the input of the decoded bitstream 
processor and that selectively connects the 

50 output of the decoded bitstream processor to 

the input of one of the encoding nrxxiules. the 
one of the encoding modules con-esponding to 
the one of the decoding modules. 

55 2. The apparatus of claim 1 . additionally comprising 
means (120, 132. 142; 720, 732) for deactivating 
the decoding modules downstream of the one of 
the decoding modules, and for deactivating the 
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encoding nxxJuIes 
encoding modules. 



upstream of the one of the 



3. The apparatus of claim 1 or 2. in which: 

the layered decoder includes deriving means 
(e.g.. 203; 712) for deriving bitstream parame- 
ters from the compressed input bitstream; 
the apparatus additionally comprises a bit- 
stream parameter forwarding path (128, 728) 
that interconnects the layered decoder to the 
layered encoder; and 

at least one of the encoding modules is con- 
nected to the parameter Ibnwarding path and 
performs an encoding operation using the bit- 
stream parameters derived from the com- 
pressed input bitstream by the deriving means. 



the layered encoder re-uses the bitstream 
parameters to re-encode the modified bit- 
stream. 

5 7. The apparatus of claim 6. in which: 



the decoded bitstream processor is additionally 
connected to the bitstream parameter fonward- 
ing path (128. 728); and 
the decoded bitstream processor processes 
the decoded bitstream in response to the bit- 
stream parameters derived from the com- 
pressed input bitstream by the deriving means. 



10 



15 8. 



A method for processing a compressed input bit- 
stream representing an information signal, the 
method comprising: 



4. Apparatus (100. 700) for modifying bitstream char- 
acteristics of a compressed Input bitstream repre- 20 
senting an information signal, the apparatus 
comprising: 

a controller (120, 720) that provides an output 
bitstream definition defining bitstream charac- 25 
teristics of a compressed output bitstream; 
a layered decoder (114. 71 4A) that decodes 
the compressed input bitstream (112, 712) to 
provide a decoded bitstream (116, 71 6A). the 
layered encoder including deriving means 30 
(e.g.. 203. 719) for deriving bitstream parame- 
ters from the compressed input bitstream; 
a bitstream parameter fonwarding path (128, 
728) connected to receive the bitstream 
parameters from the layered decoder ; 3S 
a layered encoder (124. 724) connected to the 
bitstream parameter forwarding path and that 
re-uses the bitstream parameters derived from 
the compressed input bitstream by the deriving 
means to re-encode the decoded bitstream in 40 
accordance with the output bitstream definition 
to provide the compressed output bitstream. 

5. The apparatus of claim 4. in which the decoded bit- 
stream is partially encoded relative to the infbrma- 45 
tion signal. 

6. The apparatus of daim 4 or 5, in which: 

the apparatus additionally comprises a so 
decoded bitstream processor (118, 718A) con- 
nected to receive the decoded bitstream (1 16. 
716) and to provide a modified bitstream (122, 
722A) to the layered encoder in lieu of the 
decoded bitstream (1 16, 716). the decoded bit- ss 
stream processor processing the decoded bit- 
stream in a way that modifies the information 
signal: and 



partially decoding the compressed input bit- 
stream (112) to provide a decoded bitstream 
(116), the decoded bitstream being a partially- 
encoded bitstream representing the informa- 
tion signal; 

generating a modified bitstream (122) by 
processing the decoded bitstream in a way that 
modifies the information signal, the modified 
bitstream being a partially-encoded bitstream; 
and 

re-encoding the modified bitstream (122) to 
generate a compressed output bitstream (1 26). 

9. The method of claim 8, in which: 

the method additionally conprises deriving bit- 
stream parameters from the conpressed input 
bltstr^m; and 

the mod'tfied bitstream (122) is re-encoded 
using the bitstream parameters derived from 
the compressed input bitstream. 

10. A method for nxxjifying the bitstream characteris- 
tics of a compressed input bitstream representing 
an information signal, the method comprising: 

generating an output bitstream definition defin- 
ing bitstream characteristics of a compressed 
output bitstream; 

deriving bitstream parameters from the com- 
pressed input bitstream (1 12); 
at least partially decoding the compressed 
Input bitstream to provide a decoded bitstream 
(116): and 

re-encoding the decoded bitstream using the 
bitstream parameters derived from the com- 
pressed input bitstream to generate the com- 
pressed output bitstream (126) having the 
bitstream characteristics defined by the output 
bitstream definition. 
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11. The method of claim 10, in which the bitstream 
parameters derived from the compressed input bit- 
stream are bitstream parameters generated using 
large computational resources. 

5 

12. The method of claim 10 or 1 1 . in which: 



13. The method of claim 10. 11 or 12. in which the 
decoded bitstream is processed in response to the 20 
bitstream parameters. 

14. Apparatus (700) for processing a compressed input 
bitstream representing an information signal, the 
compressed input bitstream having a compression 25 
state, the apparatus comprising: 



of the encoding/decoding modules 
depending on the compression state of the 
output bitstream. 

15. The apparatus of claim 14. additionally comprising 
means for deactivating ones of the encod- 
ing/decoding modules not required to change the 
compression state of the input bitstream. 

16. Hie apparatus of daim 14 or15, in which: 

the first compression state translation unit 
includes means for deriving bitstream parame- 
ters from the input bitstream; 
the apparatus additionally comprises a param- 
eter fonwarding path (728) that interconnects 
the first compression state translation unit and 
the second compression state translation unit; 
and 

at least one of the encoding/decoding modules 
of the second compression state translation 
unit is connected to the parameter fonwarding 
path and performs an encoding operation using 
the bitstream parameters derived from the 
compressed input bitstream. 

17. A method for processing a compressed input bit- 
stream representing an information signal, the com- 
pressed input bitstream (712) having a 
compression state, the method comprising: 

providing layered encoding/decoding modules 
(e.g.. 705. 707,709. 711); 
selecting a first at of encoding/decoding mod- 
ules and a second set of encoding/decoding 
modules from the layered encoding modules; 
changing the conpression state of the com- 
pressed input bitstream (71 2) using the first set 
of encoding/decoding modules to provide a first 
output bitstream (71 6A); 
processing the first output bitstream to gener- 
ate a modified bitstream (722A), the first output 
bitstream being processed by in a way that 
modifies the information signal but generates 
the modified bitstream in the same compres- 
sion state as the first output bitstream; and 
changing the compression state of the modified 
bitstream using the second set of encod- 
ing/decoding nrxxlules to generate a second 
output bitstream (e.g., 716B, 726). 

18. The method of claim 17. additionally comprising: 

selecting one of an encoding mode and a 
decoding mode for the encoding/decoding 
modules of the first set; and 
selecting one of an encoding mode and a 
decoding mode for encoding/decoding mod- 



a first compression state translation unit (714A) 
that receives the compressed input bitstream 
(712) as an Input bitstream and changes the 30 
compression state of the compressed input bit- 
stream to generate an output bitstream (71 6A); 
a processor (71 8A) that receives the output bit- 
stream of the first compression state transla- 
tion unit, processes the output bitstream in a 3S 
way that modifies the information signal, and 
provides a modified bitstream; and 
a second compression state translation unit 
(724) that receives the modified bitstream as 
an input bitstream and changes the compres- 40 
sion state of the modified bitstream to generate 
an output bitstream (726), the first and second 
compression state translation units each 
including: 

45 

layered encoding/decoding modules (e.g.. 
705. 707. 709, 71 1), each having an input 
and an output 

an input interface module (719) that selec- 
tively connects the input bitstream to one so 
of the encoding/decoding modules, the 
one of the encoding/decoding nxxJules 
depending on the compression state of the 
input bitstream. and 

an output interface module (721) that ss 
selectively receives a bitstream from the 
output of one of the encoding/decoding 
modules as the output bitstream. the one 



the method additionally comprises processing 
the decoded bitstream (116) to generate a 
modified bitstream (122). the decoded bit- 10 
stream being processed in a way that nxxlifies 
the information signal; and 
the modified bitstream is re-encoded in lieu of 
the decoded bitstream to generate the conv 
pressed output bitstream. the modified bit- is 
stream being re-encoded using the bitstream 
parameters. 
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ules of the second at 

19. The method of claim 17 or 18. in which: 

the method additionally comprises deriving bit- s 
stream parameters from the compressed input 
bitstream; and 

the compression state of the modified bit- 
stream is changed using the bitstream parame- 
ters derived from the compressed input io 
bitstream. 

20. The method of claim 17. 18 or19, in which: 

the method additionally comprises deriving bit- is 
stream parameters from the compressed input 
bitstream; and 

the first output bitstream is processed using the 
bitstream parameters derived from the com- 
pressed input bitstream. 20 
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